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Method of processing serial data signals 



FIELD OF THE INVENTION 

The present invention relates to methods of processing serial data signals, for 
example 1-bit audio data signals. Moreover, the invention also relates to the methods adapted 
for watermarking purposes. Furthermore, the invention relates to apparatus arranged to 
5 implement the method and also data content generated processed or watermarked according 
to the method. 

BACKGROUND OF THE INVENTION 

Analogue signals, for example analogue audio signals, can be sampled in 

10 several alternative ways in order to generate corresponding representative digital data. It is 
conventional practice, for example for contemporary audio compact optical disc data carriers 
(CD's), to sample audio signals at a sampling rate of f s = 44. 1 kHz and represent them as 1 6- 
bit pulse code modulated (PCM) format data. This sampling rate, in view of Nyquist 
sampling considerations, corresponds to an analogue audio signal bandwidth of substantially 

15 22 kHz. Such sampling is relatively easy to implement using contemporary proprietary 
integrated circuit chip sets specific adapted for executing such sampling. 

An alternative format which is frequently employed is 1-bit format, also 
known as unity bit coding referred to as direct stream digital (DSD), which is employed in 
high quality audio reproduction systems, for example in the contemporary Super Audio CD 

20 (SACD). In SACD systems, the sampling frequency employed is increased to 64ft to generate 
a serial sequence of 1 -bit data samples. In such a sequence, each sample having a value of 
logic 1 or 0 representing real signal states of +1, -1 respectively subject to normalization. 
Conventionally, 1-bit sample data is frequently generated using a Sigma-Delta modulator. 
The audio bandwidth provided by 1 -bit sampling at a sampling rate of 64f s extends up to 1 00 

25 kHz. 

Unauthorised copying of proprietary audio data content is a known problem, 
for example as in counterfeiting and pirate copying, which potentially financially affects 
music recording companies. Moreover, such copying can arise from copying data directly 
from one data carrier to another, as well as from data content distribution via communication 
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networks such as the Internet, In order to try to discourage such unauthorised copying, it is 
conventional practice to include watermarking in proprietary audio data content so that routes 
of distribution and copying of data content can be ascertained and measures taken to deter 
such copying, for example by imposition of fines or levies. 
5 It is known to include watermark data in unit-bit coded (DSD) audio signals. 

For example, in a published United States patent application no. US 2001/0066408, there is 
described conversion of an original high-quality 1-bit coded (DSD) audio signal having a 
2.822 MHz bit rate to a PCM signal of relatively lower sampling rate by means of a sample 
rate converter. A watermark signal is embedded into the PCM signal by using a conventional 
10 PCM watermark embedder. Subsequently, the watermarked PCM signal is re-converted back 
to a 1 -bit coded format signal for purposes of generating a final watermarked 1-bit coded 
signal. The inventors have appreciated that this watermarking approach is potentially costly 
and complex and therefore have endeavoured to provide a more direct and potentially simpler 
method of including a watermark signal with unit-bit coded sample data. 

15 

SUMMARY OF THE INVENTION 

An object of the invention is to provide an alternative method of including 
watermark information in a 1-bit coded data signal. 

According to a first aspect of the present invention, there is provided a method 
20 of processing a serial data signal to generate a corresponding transformed signal, the method 
including the steps of: 

(a) providing one or more signature sequences; 

(b) analysing the serial data signal to determine therein one or more signal 
sequences for which holds that combining such one or more signal sequences with said one 

25 or more signature sequences does not result in generation of illegal states; and 

(c) combining one or more of the determined signal sequences of the serial data 
signal with said one or more signature sequences so as to transform the serial data signal into 
the transformed signal. 

The invention is of advantage in that it is capable of enabling the serial data 
30 signal to be directly transformed to generate the transformed signal without there being a 

need to convert the serial data signal to another.intermediate formatfor processing purposes. 

I^'combM^ 

but not limited thereto, one or more of: addition, subtraction, exclusive-OR. Moreover, 
"illegal states" refers to states arising from combining the serial data signal and one or more 
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of the signature sequences,, these states not being accommodated in a format pertaining to the 
transformed signal; such illegal states are susceptible to giving rise to informatioifloss when 
the transformed signal is subsequently processed to regenerate the serial data signal. 
Furthermore, "desired illegal states" in the context of the present invention refers to where a 
certain degree of irreversible degradation is desired, for example for providing degraded 
music samples as a preliminary to providing a corresponding non-degraded music sample in 
return for payment. 

The present invention is not limited to serial binary data streams for 
processing to generate corresponding transformed signals, but is equally applicable to signals 
with three or more states. Moreover, the invention is also applicable to parallel data streams, 
for example 16-bit data buses, wherein each individual stream is susceptible to being 
processed according to the invention to generate one or more corresponding transformed data 
streams. 

Preferably, in the method, the serial data signal is a 1-bit data signal in binary 
format, and the one or more signature sequences are arranged to be directly combinable with 
the serial data signal to generate the transformed signal in binary format, preferably such 
combination involving addition and/or subtraction and/or exclusive-OR operations. 

The invention is of benefit in that it is not necessary to convert the 1-bit signal 
to other formats to generate the corresponding transformed signal. More preferably, the serial 
data signal is arranged such that its series of symbols have substantially similar significance; 
hitherto, it is been difficult to watermark such data, for example by spoilation of least 
significant bits, without converting the data to a hierarchical bit format, for example PCM. 

Preferably, in the method, the one or more signature sequences are useable to 
reversibly transform the transformed signal to regenerate a copy of the serial data signal 
therefrom. Such reversibility is of benefit in situations where when degraded sample data are 
issued substantially free-of-charge to potential customers such that, on subsequently payment 
of a fee, the customers are provided with a decryption key for decoding the degraded sample 
data. However, the invention is also applicable in a mode where the degraded sample is 
irreversibly degraded by applying the method of the invention and allowing for the 
generation of at least some illegal states in the transformed signal giving rise to irreversible 
information loss. In such a situation, there can arise illegal states which are desired for 
irreversibly degrading the firee-of-charge sample and hence is encompassed by the scope of 
the present invention. 
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Preferably, in the method, a plurality of signature sequences is employed in 
the method. Use of a plurality of signature sequences enables complex encoding to be 
performed, for example watermarking which is non-trivial to circumvent. 

Preferably, in the method, the one or more signature sequences are each two or 
5 more symbols long. Whereas relatively shorter sequences can be included frequently in the 
transformed data on account of numerous locations at which the shorter sequences match that 
of the serial data signal, longer sequences are susceptible to being more specific and therefore 
their occurrence in the transformed data corresponds to greater information content. More 
preferably, in the method the one or more signal sequences for which holds that combining 

10 such one or more signal sequences with said one or more signature sequences does not result 
in generation of illegal states are selected according to a perceptual model to obtain a 
preferred perceived characteristic in the transformed signal; such a selective approach 
enables watermarks to be applied to audio data in a manner which is least subjectively 
obtrusive to listeners and yet is easily detectable for counterfeit identification purposes. 

1 5 Preferably, in the method, the serial data signal and the transformed signal are 

1-bit audio signals, and the combination of the one or more signature sequences is performed 
directly on the serial data signal without transforming to another signal format. The method 
therefore is of advantage in that it can be applied directly to 1-bit audio signals for signal 
processing purposes without need to translate the serial data signal into other signal formats. 

20 Preferably, the method is arranged to embed a watermark in the serial data 

signal so that the transformed signal is a watermarked version of the serial data signal. More 
preferably, insertion of the watermark is executed by a sound recording manufacturer and/or 
and sound recording distributor, for example an Internet web site configured to deliver data 
music files in return for payment. 

25 According to a second aspect of the invention, there is provided an apparatus 

for implementing the method according to the first aspect of the present invention, the 
apparatus being arranged to receive the serial data signal and output the transformed data. 

According to a third aspect of the present invention, there is provided 
transformed data generated using the method according to the first aspect of the invention. 

30 The transformed data is preferably supplied on a data carrier, for example an optical disc 

- - - data-carrying medium, and/or via a communication network, for example the Inteniet. _ 

According^ 

computer software operable when executed on a computing device to implement the method 
according to the first aspect of the present invention. 
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According to a fifth aspect of the present invention, there is provided a method 
of processing a transformed signal to regenerate a corresponding decoded serial data signal, 
the method including the steps of: 

(a) providing one or more signature sequences; 

O) analysing the transformed signal to determine therein one or more signal 

sequences for which holds that combining such one or more signal sequences with said one 
or more signature sequences does not result in generation of illegal states; and 
(c) combining one or more of the determined signal sequences of the transformed 

signal with said one or more signature sequences so as to transform the transformed signal to 
regenerate therefrom the decoded serial data signal. 

According to a sixth aspect of the present invention, there is provided an 
apparatus for implementing the method according to the fifth aspect of the invention, the 
apparatus being operable to receive the transformed data signal and output the decoded serial 
data signal data. 

According to a seventh aspect of the present invention, there is provided 
computer software operable when executed on a computing device to implement the method 
according to the fifth aspect of the invention. 

It will be appreciated that features of the invention are susceptible to being 
combined in any combination without departing from the scope of the invention. 

DESCRIPTION OF THE DIAGRAMS 

Embodiments of the invention will now be described, by way of example only, 
with reference to the following diagrams wherein: 

Figure 1 is a graph illustrating spectral characteristics of a subset of sequences 
selected from Table 1, including a trivial sequence [1, -1] for comparison; 

Figure 2 is an apparatus according to the invention for implementing a method 
according to the invention; 

Figures 3a, 3b are illustrations of two sequences being analysed for 0- 
matching or 1 -matching according to the invention; 

Figures 4a, 4b are illustrations of two sequences being analysed for 0- 
matching or 1 -matching where a change of relatively few bits can significantly alter 
information conveyed, for example for watermarking purposes; and 
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Figure 5 is a graph of spectra corresponding to four best sequences 
S e {- 1,0,+ 1} 1 2 exhibiting a minimal disturbance around a frequency f = 32 f s where f s is a 
sampling frequency, said sequences being selected from Table 2; 

Figure 6 is a graph of spectra corresponding to four best sequences 
5 S g {- 3,-2,-1,0,+ 1,+2,+3} 5 with a spectrum of a sequence S=[l,-1] included as a broken line 
for comparison; 

Figure 7 is a graph of spectra corresponding to four best sequences 
S e {- 1,0,+ 1} 12 exhibiting a minimal disturbance around a frequency f = 0 Hz; and 

Figure 8 is a graph of four best sequences from Table 2 subject to modulation 
10 using a complex carrier c[n]=j n . 

DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

In devising the present invention, the inventors have envisaged that it is not 
permitted in general simply to add two 1-bit audio signals, each signal comprising a sequence 
15 of symbols having values 1 or 0, because their corresponding symbol states of 1 and -1 
respectively can potentially sum to any one of three values, namely -2, 0, +2. Even after 
scaling by a factor of 2, such values no longer conform to the aforementioned DSD format 
for 1 -bit sample signals and are considered in the context of the present invention to be illegal 
states. 

20 The inventors have appreciated that when a 1 -bit sample signal is to have 

added directly thereto watermark information, when the sample signal has a state -1, a 
watermark signal value of 0 or +2 may be added to it. Similarly, when the sample signal has a 
state +1, a watermark signal value of 0 or -2 may be added to it. Thus, if a signature sequence 
(hereinafter also referred to as watermark sequence) is devised comprising states of -2, 0, 2, 

25 such a signature sequence is susceptible to being directly added to a 1-bit DSD audio signal 
to generate a subsequently watermarked 1-bit audio signal in conformity with the DSD 
standard. 

1-bit audio signal sequences X will be represented in square brackets in 
Equation la (Eq. la). They have symbols whose states as defined by Equation lb (Eq. lb). 

30 _ 

^==\y^^ 

Xe{0,l}* 



-Eq— 1-a- 



Eq. lb 
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where 

v = a symbol in the sequence X, the symbol v having logic values of 1 or 0 

corresponding to symbol states of +1 and -1; such that v f s subscripts are indicative of a 
temporal sequence of the symbols v, namely there are n symbols in the sequence V with 
symbol vi being temporally first and symbol v n being temporally last; and 
k = a positive integer. 

As explained above, given watermark sequences may be added to some but 
not all signal sequences X. For example, adding a watermark sequence S = [1, -1] to signal 
sequence X = [-1, 1] according to Equation 2 (Eq. 2) results in a legal watermarked sequence 
Y: 

Y = X + 2S = [1,-1] Eq.2 

Addition of this particular watermark signal S to the sequence signal X 
implemented as a 1-bit audio signal corresponds temporally locally to a multiplication of -1. 
For X being a 1-bit audio signal sequence, such local multiplication does not change the low- 
frequency component of the watermarked signal Y significantly in comparison to the original 
1-bit audio signal X, but results in relatively major higher frequency artefacts. Such a change 
in higher-frequency energy is illustrated in Figure 1. In this Figure, there is included an 
abscissa axis 20 corresponding to a frequency range from 0 kHz to 44.1 kHz, and an ordinate 
axis 30 corresponding to signal frequency component spectral amplitude. Reference numeral 
10 denotes the increased noise across the audio spectrum introduced by adding the watermark 
sequence S = [1, -1]. 

The inventors have appreciated that there are more sequences S that may be 
added to the signal X=[-l, 1] which still yield a corresponding binary signal Y devoid of 
illegal states. One such sequence is S=[l, 0], and another is S=[0, -1]. A zero in the sequence 
S implies that a corresponding sample in the signal X may have a signal value of -1 or +1 . 
However, these sequences are less suitable in view of the distortion they introduce in digital 
audio signals. Obviously, the sequences S=[0], S=[0,0], S=[0,0,0] etc. are not of practical 
use. 

The signature sequence S=[l, -1] may not be added to signal sequences X 
other than [-1, 1] because a non-compliant non-binary corresponding signal Y would result, 
namely an illegal result. However, the sequence may be subtracted from a signal sequence 
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[1, -1] of the signal X; equivalency, a corresponding negated sequence S=[-l, 1] may be 
added to a sequence [1, -1] in the signal X. Addition of such sequences does not affect 
distortion arising within a signal as its frequency spectrum for low frequencies is not altered 
appreciably by such addition. 
5 Other signal sequences X require other signature sequences, for example the 

watermark sequence S=[-l, -1] may be added to a signal sequence X=[l, 1]. However, the 
sequence S=[-l, -1] has a significant effect in the low frequency region of the signal X when 
combined therewith. Combining such a sequence to a 1-bit audio signal, for example by 
adding to an aforementioned DSD signal, would result in unacceptable distortion for 

10 watermarking purposes. Alternative watermarking sequences such as S=[0, -1] or S=[-l, 0] 
are also not suitable for use in watermarking. 

It appears that the watermark sequence [1, -1] is far from optimal. The 
inventors have considered a large number of signature sequences of various lengths and 
evaluated their impact on the audio signal quality. The following Table 1 lists such signature 

1 5 sequences Si up to length 12. A value R in the Table corresponds to the ratio of energy of an 
associated sequence in a frequency band from 0 Hz to the sampling frequency and the 
sequence being a unit pulse. The unit pulse itself is included in the Table 1 as The 
sequences Si are listed in order of ascending order of R. For comparison, the table also 
includes the above mentioned sequence S = [1, -1], viz. S41- 

20 The graphs Si, S 2 , S 3 , S 4 in Figure 1 denote the increased noise spectra 

associated with the first four signature sequences listed in Table 1. It will be appreciated that 
they are far more suitable for watermarking purposes than the "simple" sequence S41 = [1, -1] 
described above. 

25 Table 1: Example signature sequences for 1-bit audio signals 



i 


Sequence Si 


R(dB) 


1 






-1 


0 


1 


0 


0 


1 


0 


-1 


-1 


1 


-60.77 


2 






-1 


0 


1 


1 


-1 












-53.42 


3 






-1 


1 


-l 


1 


1 


-1 










-50.94 


4 






1- 


1 — 


-1 - - 


. L 


0 


1- 


0 


.-1 


. -1 „ 


JL . _ 


-49.26. 


5 






-1 


0 


1 


0 


1 


-1 


1 


-1 


-1 




-^4926 


6 






-1 


1 


0 


-1 


1 


1 


-1 








-49.03 
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7 


1 


- 1 




0 


1 


0 


1 


0 


-1 


-1 


1 




-48.86 


8 


1 


- 1 


-l 


1 


0 


0 


-1 


1 


1 


-1 






-17.47 


9 


1 


- 1 


0 


-1 


0 


1 


0 


1 


-1 








-47.43 


10 


1 


- 1 


-l 


1 


0 


0 


0 


-1 


1 


1 


-1 




-46.17 


11 


1 


- 1 


-l 


0 


1 


0 


1 


-1 










-45.59 


12 


1 


- 1 


0 


-1 


0 


1 


1 


-1 










-45.59 


13 


1 


- 1 


0 


-1 


1 


-1 


1 


0 


1 


-1 




-1 


-45.52 


14 


1 


- 1 


-1 


1 


0 


0 


0 


0 


-1 


1 


1 




-45.05 


15 


1 


- 1 


-1 


1 


-1 


1 


0 


1 


-1 








-44.74 


16 


1 


- 1 


0 


-1 


1 


-1 


1 


1 


-1 








-44.74 


17 


1 


- 1 


0 


-1 


1 


0 


-1 


1 


0 


1 


-1 




-43.97 


18 


1 


- 1 


0 


-1 


1 


0 


-1 


1 


1 


-1 






-43.88 


19 


1 


- 1 


-1 


1 


0 


-1 


1 


0 


1 


-1 






-43.88 


20 


1 


- 1 


0 


-1 


0 


1 


0 


0 


1 


-1 






-43.15 


21 


1 


-1 


0 


0 


-1 


0 


1 


0 


1 


-1 






-43.15 


22 


1 


- 1 


-1 


1 


0 


0 


-1 


1 


0 


1 


-1 




-43.04 


23 


1 


- 1 


0 


-1 


1 


0 


0 


-1 


1 


1 


-1 




-43.04 


24 


1 


- 1 


0 


0 


-1 


0 


1 


0 


0 


1 


-1 




-43.04 


25 


1 


- 1 


0 


-1 


1 


0 


0 


-1 


1 


0 


1 


-1 


-42.66 | 


26 


1 


- 1 


-1 


1 


-1 


1 


1 


-1 


1 


-1 


-1 


1 


-42.31 


27 


1 


- 1 


-1 


1 


0 


0 


0 


-1 


1 


0 


1 




-42.24 


28 


1 


- 1 


0 


-1 


1 


0 


0 


o 


-1 


1 


1 


-1 


-42.24 


29 


1 


- 1 


-1 


1 


0 


-1 


1 


1 


0 


-1 


-1 


1 


-42.24 


30 


1 


- 1 


-1 


0 


1 


1 


-1 


0 


1 


-1 


- 1 


1 


-42.24 


31 


1 


- 1 


0 


-1 


0 


1 


0 


1 


0 


-1 


- 1 


1 


-42.23 


32 


1 


- 1 


-1 


0 


1 


0 


1 


0 


-1 


0 


- 1 


1 


-42.23 


33 


1 


- 1 


-1 


1 


1 


-1 


-1 


0 


1 


0 


1 


-1 


-42.13 


34 


1 


- 1 


0 


-1 


0 


1 


1 


-1 


-1 


1 


1 


-1 


^•2.13 


35 


1 


- 1 


-1 


1 


-1 


1 


1 


0 


-1 


-1 


1 




-42.05 


36 






-1 


0 


1 


1 


-1 


1 


-1 


-1 






-42.05 


37 






0 


0 


-1 


1 


-1 


1 


0 1 


1 






-42.00 


38 






0 


-1 


1 


-1 


1 


0 


0 


1 






-42.00 


39 






-1 


0 


1 


1 


0 


-1 


-1 


1 






-41.86 
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40 


l 


-l 


0 


0 


-l 


l 


-l 


l 


0 


0 


1 


-1 


-41.49 


41 


l 


-l 






















-24.93 


42 


l 
























0 



Note that all the example sequences in Table 1 commence with a normalized value L There 
inverse counterparts are equally useable, but are not shown in the Table. Note further that the 
sequences have been evaluated for a particular application (here: watermarking of DSD 
5 audio). For other applications, other sequences will be optimal. 

In order to further described the present invention, a nomenclature as provided 
in Equation 3 (Eq. 3) will be adopted in the following: 



Si = El Si [n] Eq.3 

n 

10 

where Si[n] is a watermark sequence and n is the index of symbols in the sequence. 

The inventors have introduced the expression "matching sequences". A signal 
sequence X is said to "match" a given signature sequence Si if Si can be combined with X 
(e.g. added to X or subtracted from X) without introducing illegal states. Mathematically, a 

15 signal sequence is matching if the absolute inner product |(x,Si)| equals Si . More 

/ \ A 

particularly, if (X,S. ) = , the sequence X is said to be "1 -matching". Conversely, if 

(X,S i ) = -Si , the sequence X is said to be "0-matching". 

Equation 4 (Eq. 4) below shows that the signature sequence Si (or 
mathematically more precisely: 2Si) can be subtracted from a 1 -matching signal sequence X. 
20 Such subtraction causes a watermarked sequence Y to be generated. 

<X,S,.) = St ^X-IS^Y Eq. 4 

Note that subtraction turns the 1 -matching sequence X into a 0-matching sequence Y. 

Similarly, Equation 5 (Eq. 5) below shows that the signature sequence Si can 
_ _ be added to a, 0-matcMpig signal sequence X. 

~25 (jr,5 i ) = -S,=>Jr + 2S, =7 Eq.5 
Note that addition turns the 0-matching sequence X into a 1 -matching sequence Y. 
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In accordance with the invention, a signal is now processed by inspecting it for 
occurrences therein of sequences X that match a predetermined signature sequence Si (or a 
plurality of predetermined signature sequences). It will be appreciated that signal symbols 
corresponding to "0" states in the signature sequence Si can be superficially regarded as 
"don't care" values in such a search process. Where matching sequences X occur, they are 
modified in accordance with a given processing algorithm. 

For example, in accordance with one aspect of the invention, a 1-bit audio 
signal to be watermarked is analysed for occurrences of signal sequences X that match a 
given signature sequence Si. The series of occurrences of matching sequences in the audio 
signal is considered to constitute a data channel. More particularly, the occurrence of a 
1 -matching sequence is considered to constitute a data bit 4 1 % and the occurrence of a 
0-matching sequence is considered to constitute a data bit '0\ This is illustrated in Figure 3a, 
where a 1-bit audio signal to be watermarked is analysed for occurrences of length-7 
sequences X that match the length-7 signature sequence S 2 = [1, -1, -1, 0, 1, 1, -1]. The 
Figure shows that a data message '1 10 1 may be considered to be embedded or buried in the 
audio signal. 

Obviously, the data channel in Figure 3a conveys random data, because the 
data bits are derived from arbitrary audio content. Therefore, in a data embedding stage, the 
audio signal is modified to convey a desired data message. If the data bit to be embedded is 
6 0', then the embedding stage modifies a 1 -matching sequence into a 0-matching sequence by 
subtracting therefrom the signature sequence S 2 . Similarly, if the data bit to be embedded is 
6 1% then the embedding stage modifies a 0-matching sequence into a 1 -matching sequence by 
adding thereto the signature sequence S 2 - Obviously, a matching sequence X is not modified 
if it already represents the data bit to be embedded. Figure 3b illustrates how the DSD audio 
signal, which is shown in Figure 3a, has been modified in this manner to obtain a 
watermarked audio signal having a desired embedded data message ! 01 l f . 

An embodiment of the arrangement according to the invention will now be 
described with reference to Figure 2. A watermarking apparatus is indicated generally by 100 
and comprises a first store (X) 1 10 for receiving a 1 -bit audio signal X, a second store (S) 
120 for storing a watermark sequence S, and a matching function (MF) 130 for comparing 
sequences of the signal X with the watermark S to determine occurrences of matches of the 
watermark S to the signal X as described in the foregoing. There is thereby generated a data 
channel (DC) indicative of where matches occur in the signal X. The apparatus 100 further 
includes an arithmetic unit (AU) 140, which receives a desired data message D to be 
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embedded. The unit 140 is arranged to combine the signals X and S, namely by adding or 
subtracting the watermark sequence S to matching sequences X, as appropriate without 
violating the aforementioned rules so as to generate a watermarked output signal Y in the 1- 
bit format Preferably, the apparatus 100 is implemented using computing devices. 
5 Alternatively, it can be implemented in dedicated logic hardware, for example using an 
application specific integrated circuit (ASIC). 

The sequence S in the apparatus 100, for example, is a 7-symbol long 
sequence S=[l, -1, -1, 0, 1, 1, -1]- The input signal X is preferably a DSD audio signal. The 
matching function MF 130 is operable to inspect occurrences of matching sequences in the 

10 signal X corresponding to the 7-symbol watermark sequence. In one embodiment of the 

invention, the data channel (DC) is indicative of where matches occur in the signal X. More 
particularly, an occurrence of a 1 -matching sequence is considered to constitute a data bit "1" 
in the data channel DC; likewise, an occurrence of a 0-matching sequence is considered to 
constitute a data bit "0" in the channel DC. Such identification of matches is shown in Figure 

15 3a which shows that a data sequence "110" is considered to be embedded or buried in the 

DSD signal X. Moreover, the data channel DC in such a situation is considered to be random 
data, because its data bits are derived from arbitrary audio content of a substantially pseudo- 
random nature. 

When the apparatus 100 is to embed "0" data in a 1-bit serial audio signal, the 
20 AU 140 modifies a 1 -matching sequence into a 0-matching sequence by subtracting the 

watermark sequence S therefrom. Similarly, when the apparatus 100 is to embed "1" data in a 
1-bit serial audio signal, the AU 140 modifies a 0-matching sequence into a 1 -matching 
sequence by adding the watermark S thereto. The matching sequence X is not modified if it 
already represents a particular data bit to be embedded. 
25 In the aforesaid embodiment of the invention in Figure 2, a running window of 

7-symbols length is used to detect matching sequences. As shown in Figures 3a and 3b, this 
results in matching sequences which are not uniformly spaced apart. It is also potentially 
possible to identify occurrences of sequences which overlap. An example of such overlap is 
illustrated in Figure 3a and denoted by 300. In the apparatus 100, overlapping sequences are 
30 preferably ignored. Another potential problem of employing such a running window is 

illustrated in Figures 4a and 4b. A signal shown in Figure 4a contains the data sequence 

'TlTTBy appropriate subtraction of sequenwStbe-sign^ 
sequence "010" shown in Figure 4b. However, changing the third 1 -matching sequence into a 
0-matching sequence causes an occurrence of an earlier 1 -matching sequence 310 as shown 
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in Figure 4b. Such overlapping problems can be at least partially circumvented by not 
employing a running window as depicted in the apparatus 100 in Figure 2, but dividing the 
signal X into successive non-overlapping regions which are individually searched for 
occurrence of matching sequences therein. 

Thus, in overview, the method of the present invention concerns an approach 
to embedding watermark information in 1-bit programme data content by performing a 
combining operation, for example as depicted in Equation 2 for changing signal data from a 
positive sense to a negative sense in response to a sequence of bits present in the original 
programme data content. An effect of the watermarking is to degrade watermarked signal-to- 
noise and/or distortion characteristics, especially at relatively higher frequencies, for example 
at upper frequencies of the audio band wherein the sequence corresponds to digital audio 
data. 

The inventors have appreciated that it is feasible to embed additional data into 
a 1 -bit audio signal generated in a contemporary Sigma-Delta modulator by overruling a 
splicer output included of the modulator. The additional data can be input in respect of a 
temporal grid, namely temporal frame of reference. However, such an approach is potentially 
disadvantageous because stability conditions of a feedback loop employed within the Sigma- 
Delta modulator may potentially be violated. 

In the method of the invention, watermark data is preferably not inserted into 
the feedback loop of the aforementioned Sigma-Delta modulator, so that stability issues do 
not arise. 

In the method, for a particular sequence X corresponding to a 1-bit audio data 
stream, the sequence X is searched with respect to a watermark sequence Si for identifying 
matches which result in a random series of 1 -matches and 0 matches; for example, in 
Equation 2, the sequence S* is effectively compared at various positions along the signal X to 
search for identifying matches. The series of matches can be considered as a data channel. 
Thus, when processing the signal data X in Equation 2 to generate a watermarked signal data 
Y by using a watermark data S, a 0-match is replaced by a 1 -match in a case when a 1 -digit 
has to be embedded if a 0-digit is present. Similarly, a 1 -match is replaced by a 0-match in a 
case when a 0-digit has to be embedded if a 1 -digit is present. 

Preferably, for ease of processing, the method is arranged to assume that two 
adjacent matching sequences in the signal X should be non-overlapping; namely, the method 
can be arranged to disregard matched sequences in the signal X relative to the watermark 
data S which overlap. However, in order to improve watermarked signal quality, a minimum 
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distance can optionally be set for successive matches which are allowed to cause 
modification of the signal X to generate the signal Y. 

Positions along the signal data X, at which matches are identified in Figure 2 
and which result in a corresponding negation change in the sequence of the data X to 
5 generate the signal data Y, is preferably distributed so as to result in a particular type of 
disturbance as perceived, for example by human listening, in the watermarked signal Y. 
Skipping modification of parts of the signal X to generate the signal Y depending on matches 
with the watermark data S is preferable executed under control of an aural perceptual model, 
for instance a mathematical model whose parameters are determined from human aural 
1 0 perception tests. 

In the method, it will be appreciated that more than one watermarking 
sequence Si can be optionally utilized for watermarking purposes. A communication protocol 
is preferably employed, for example marker data, so that a plurality of watermarking 
sequences can be employed in processing the signal X to generate the corresponding 
15 watermarked signal Y; the marker data is preferably indicative of switches from one 
watermarking sequence to another. Such a plurality of watermarking sequences can be 
preferentially dynamically selected so as to enhance audio quality whilst also allowing for 
inclusion of the watermark signal. 

On account of the aforementioned method of the invention being most 
20 appropriate only for certain types of signal data, for example audio data, it is to be regarded 
as a relatively "fragile" type of scheme in comparison to robust schemes which are applicable 
to all types of data, for example complex general-purpose encryption methods. 

For PCM types of signals, it is a known procedure to degrade signal quality by 
"spoiling" one or more least significant bits in each data sample. Such spoiling can be 
25 implemented to be reversible using a cryptographic algorithm arranged so that, if the key is 
known, an original high-quality un-degraded signal can be reconstituted by using the key. 
Such spoliation applied to high-quality PCM signals is beneficially used for generating 
corresponding lower quality degraded signals; potential customers can be permitted free-of- 
charge to evaluate the lower quality signals and then elect to purchase one or more keys for 
30 decrypting the lower quality signals to regenerate the corresponding high-quality signals 

. ... therefirom,-Such distribution is especially ^pertinent-to music data content distributed via . 

communication networks, for exan^le"via"the"lnternet 

However, such approaches to signal spoilation with associated decryption keys 
is not readily applicable to 1-bit audio signals as described in the foregoing, for example the 
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signal X, on account of the bits in the sequence X all having a comparable degree of 
significance. The present invention is however of benefit, for example, in reversibly 
degrading 1-bit audio signals to generate degraded quality signals for free-of-charge 
distribution to entice potential customers. Such encryption can be achieved, for example, by 
replacing aforementioned 0-matches with 1 -matches and vice versa, preferably using a secret 
watermarking sequence. During decryption, toggling under control of the same sequence is 
repeated, thereby restoring a 1-bit degraded audio signal to its original high-quality form. 
When reversible spoilation of a 1 -bit signal is envisaged, it is not necessary to optimize using 
sequences Si which result in relatively little energy in the audio bandwidth of the signal X. 
Preferably, different sequences Si can be utilized which result in different apparent degrees of 
signal degradation. Such different sequences can be arranged to be dynamically changeable, 
for example under control of data in a control channel. 

The method of the invention can be regarding as a process of selectively 
toggling of -1 and +1 values by matching and then applying a combining operation, for 
example adding. Although the method is described in the forgoing as relating to binary 
signals, it is also application to signals having more than two states which are to have 
watermark information added thereto as described later. 

The watermark sequences S described in the foregoing are preferably designed 
to contribute a relatively low energy at lower frequencies, for example as presented in Figure 
1. However, the watermark sequences S are susceptible to being designed to exhibit similar 
behaviour at other frequency ranges. For example, the watermark sequence Si[n] can be 
replaced by another watermark sequence Si[n](-l) n which is capable of exhibiting relatively 
low energy in a frequency range close to half the sampling frequency, namely at fs/ 2 . 
Sequences can be designed that exhibit relative low energy at other frequencies, for example 
f s /4. 

As elucidated in the foregoing, the present invention concerns modifying 
digital signals, namely a series of samples, of which the sample can only assume a very 
limited number of values. 

A standard 16-bit PCM signal is also such a signal, wherein the number of 
states that each sample can assume is two, namely logic 0 and logic 1 states. As a 
consequence, were it not for the present invention, the direct addition of two such signals 
would be substantially impossible without loss of data or data corruption occurring on 
account of the generation of illegal states. 
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Thus: 

(a) to a sample value of -1, only the value 0 or +2 may be added; and 

(b) to a sample value of +1 , only the value 0 or -2 may be added. 

5 However, as elucidated in the foregoing, the present invention is not limited to 

binary signals; for example, it can also be applied to 3-bit signals where the number of states 
that a 3 -bit sample can assume is relatively limited. 

A more generalized analysis of the foregoing will now be described and its 
relevance to other types of sequences and signals considered. In general, a signal ^consisting 
10 of a sequence of £ samples, namely k symbols, where each sample can assume any of the 
states from a pre-defined set B, is described mathematically by Equation 6 (Eq. 6): 

XeB* Eq. 6 

1 5 Any 1 -bit DSD signal Xofk samples is defined, for example, by Equation 7 

(Eq. 7): 

Xe{-l,+l}* Eq.7 

20 In contradistinction, a 2-bit signal Xof k samples may, for example, be defined 

by Equation 8 (Eq. 8): 

Xe{-3-l,+l,+3}* Eq. 8 

25 and, likewise, a 3 -bit signal Xof k samples may, for example, be defined by Equation 9 (Eq. 
9): 

X e {- 7,-5,-3,-l,+l,+3,+5,+7}* Eq. 9 

30 - Sequence S-that may be combined with,_for example added to, the sequence X 

asrlefiiied^ 



Y = X+2$eB k 



Eq. 10 
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wherein the number of sequences S is limited. Thus, in the case of the aforementioned 1-bit 
signals conforming to Equation 7, the sequences S are limited as defined by Equation 1 1 (Eq. 
11): 

5 Se{-1,0,+1}* Eq. 11 

Similarly, for 2-bit signals, Equation 12 (Eq. 12) pertains for the sequences S: 
S g {— 3 ,-2 -l,0,+l,+2,+3}* Eq. 12 

10 

It is to be appreciated that whether or not a sequence S is capable of being 
combined with, for example added to, the signal XasinY = X + 2S without generating 
illegal states depends on the actual states present in the signal X; unconditionally combining, 
for example adding, the signal X with the sequence S can result in 

15 

Y€B k Eq. 13 

which is defined as an illegal state. 

20 In certain practical applications of the present invention, illegal states can be 

tolerated in certain circumstances and are included in the category "desired legal states"; such 
applications relate to, for example, irreversible partial degradation of audio and/or video 
programme content for customer sampling or initial evaluation purposes prior to purchasing 
corresponding un-degraded programme content 

25 Thus, in applying the present invention, it is of interest to combine sequences 

S that, for a given state set B, introduce limited disturbance in a special frequency interval of 
the frequency spectrum of the signal X. For example, a series of sequences S according to 
Equation 14 (Eq. 14) are listed in Table 2 and their spectral characteristics presented in 
Figure 5. These sequences have minimal disturbance in a frequency interval around 32f s 

30 where f s is a sampling frequency employed in generating the signal X; these sequences are 
susceptible to being combined with 1-bit DSD audio signals. Table 2 lists 10-best identified 
sequences S according to Equation 14 (Eq. 14): 

Se{-1,0,+1} 12 Eq.14 
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which are selected to provide minimal disturbance around f=32 f s . 



Table 2: 



i 


Sequence Si 


R(dB) 


1 






-1 


0 


1 


0 


0 


-1 


0 


1 


-1 


-1 


-60.77 


2 






-1 


0 


1 


-1 


-1 












-53.42 


3 






-1 


-1 


-1 


-1 


1 


1 










-50.94 


4 






-1 


-1 


-1 


-1 


0 


-1 


0 


1 


-1 


-1 


-49.26 


5 






-1 


0 


1 


0 


1 


1 


1 


1 


-1 


-1 


-49.26 


6 






-1 


-1 


0 


1 


1 


-1 


-1 








-49.26 


7 






-1 


0 


1 


0 


1 


0 


-1 


1 


1 




-48.86 


8 






-1 


-1 


0 


0 


-1 


-1 


1 


1 






-47.47 


9 






0 


1 


0 


-1 


0 


-1 


-1 








-47.43 


10 






-1 


-1 


0 


0 


0 


1 


1 


-1 


-1 




-46.17 



5 With reference to Table 2 and its associated Figure 5, it will be appreciated 

that the signal X and the sequence S can be combined by one or more mathematical 
processes, for example addition, subtraction, multiplication by -1, exclusive-OR to mention a 
few examples; other types of mathematical operations such as multiplication are also feasible 
within the scope of the present invention. 

10 For the signal X being a 2-bit signal according to Equation 8 in the foregoing 

having corresponding sequences S limited as defined in Equation 12, examples of some 
sequences of maximum length of 5 symbols that have a relatively low disturbance in a 
frequency interval 0 < / < f s are listed in Table 3. For comparison, performances of 
sequences S=[l,-1] and S=[l] is also shown. Moreover, frequency spectra of four best 

15 sequences are illustrated in Figure 6. 
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Table 3: 



I 


Sequence: Si 


R(dB) 


1 


1 


-3 


3 


-1 




-68.95 


2 


1 


-2 


0 


2 


-1 


-62.94 


3 


1 


-2 


1 






-47.33 


4 




-1 


-2 


3 


-1 


-47.21 


5 




_3 


2 


i 

J. 


-I 


-47.21 


6 




-2 


2 


-2 


1 


-41.33 


7 




-1 


-1 


1 




-41.31 


8 




-3 : 


-1 


3 


-1 


-41.25 


9 




-3 


1 


3 


-2 


-41.25 


10 




-1 


0 


-1 


1 


-37.80 


11 (comparison) 




-1 








-24.93 


12 (comparison) 












0 



Earlier, examples of sequences S were described, for example with reference 
to Figure 1, which are susceptible to causing minimal disturbances in a frequency interval 
around f=0 Hz, for example in an interval 0 < / < f s or - f s < f < f s . In Figure 7, there is 
shown, for comparison purposes, a mil-frequency spectrum in a range - 32/ s < / < 32 f 
corresponding to four best sequences S for S e {- l,0,+l} 12 providing minim al disturbance 
around f=0 Hz, the sequences S being listed in Table 2. In the foregoing, it is elucidated that 
sequences S can be designed to introduce minimal disturbance at other frequency intervals 
encompassing the signal X. In particular, the inventors have appreciated that it is possible to 
devise examples of the sequence S that exhibit minimal disturbance in a frequency range 
around other frequencies than f = 0 Hz. 

If a given sequence S is modified by modulation with a carrier C, then the 
frequency spectrum of the newly obtained shifted sequence S' is a shifted version of the 
spectrum of the sequence S. Beneficially, the carrier C is defined according to Equation 15 
(Eq. 15): 

*M=(-ir Eq.15 

Application of the carrier C to the sequence S is capable of shifting it by 32ft 
as provided by Equation 16 (Eq. 16): 



s>[n) = s[n](-iy 



Eq. 16 
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In consequence, a combination of the shifted sequence S' with the signal X 
results in a frequency disturbance for which minimal disturbance has changed from f = 0 Hz 
to f = 32f s . With regard to applying the carrier C to shift the sequence S, such shifting is 
trivial if the sequence 5e{- 1,0,+ 1}* where shifting results in the shifted sequence 
5 S'e {- 1,0,+ if . A list of shifted sequences are provided in the foregoing Table 2 with 
corresponding four best spectra presented in Figure 5. 

If, in combining the signal X with the sequence S, complex values are 
permitted to arise, it is envisaged that resulting spectra can be different for negative and 
positive frequencies. The aforesaid carrier C can be conveniently defined in complex form 
10 according to Equation 17 (Eq. 17): 

c[n] = j n E< 1- 17 

wherein j = V-T 

15 and its application to the signature S is to shift the spectrum of a corresponding shifted 
sequence S' to 16f s as described by Equation 18 (Eq. 18): 

4«]=*McM=*M/" E£ i- 18 

20 For the carrier C of Equation 17, it is trivial if the sequence S has a set of 

states S e {- y,-l,0,+l,+ jf that the shifted sequence will have a corresponding set of states 

{_ 7j _i s o,+1 5 + jf also. Ten best sequences S from Table 1 are modulated by/ and 
corresponding modulated sequences listed in Table 4. 
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Table 4: 



I 


Sequence: Sj 


R(dB) 


1 


1 


-j 


1 


0 


1 


0 


j 


0 


"7 


1 


-j 


-60.77 


2 


1 


-j 


1 


0 


1 


1 












-53.42 


3 




-j 




-7 


-1 


-1 


7 










-50.94 


A 




-j 




-7 


-1 


0 


-j 


0 


-j 


1 


~j 


-49.26 


5 




-j 




0 


1 


-1 


j 


1 


-7 


1 


-j 


-49.26 


6 




-J 




-7 


0 


-1 


-7 


-1 








-49.03 


7 




-J 




0 


1 


-1 


0 


-1 


-7 


-1 




-48.86 


8 




-j 




-7 


0 


1 


-7 


1 


-7 






-47.47 


9 




-J 


0 


j 


0 


0 


-7 


-1 








-47.43 


10 




-j 


1 


-7 


0 


0 


j 


1 


7 


1 




-46.17 



Spectra of four best sequences from Table 4 are plotted on a graph of Figure 8 
where an asymmetrical distribution is clearly identifiable. 
5 The method of the invention, namely combining selected sequences directly 

with signals to "imprint" the sequences upon the signals has numerous practical technical 
applications, such applications including one or more of: 

(a) special configurations of sigma delta modulators for analogue to digital signal 

conversion; 

10 (b) special configurations of multi-bit analogue to digital converters, for example 

modified versions of a converter of a type described in "A multi-bit sigma-delta ADC for 
multi-mode receivers" by Miller and Petrie, presented in Custom Integrated Circuits 
Conference, 2002. Proceedings of the IEEE 2002, May 2002, pp. 191-194; and 
(c) special configurations of complex sigma-delta converters, for example 

15 modified versions of a converter of a type described in "A fourth order continuous-time 
complex sigma-delta ADC for low-IF GSM and edge receivers" by Basedau et al., VLSI 
Circuits 2003 as published in Digest of Technical Papers, 2003 Symposium June, 2003, pp. 
75-78. 

The method of the invention is susceptible to practical application in 
20 watermarking audio and/or video programme content, for example music and/or video 

content conveyed via communication networks such as the Internet, and on data carriers, for 
example optical data carriers such as CD's, DVD's. Such watermarking is of benefit in 
discouraging unauthorised copying, namely pirating, of programme content and can be used 
as evidence to take legal action against counterfeiters, for example injunctions and/or 
25 delivery up of counterfeit copies. Conversely, in a manner akin to currency bank notes, such 
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watermarking can also be used for authentication purposes so customers can verify that they 
have purchased a bona fide original programme content product. 

It will be appreciated that embodiments of the invention described in the 
foregoing are susceptible to being modified without departing from the scope of the invention 
5 as defined by the accompanying claims. 

Expressions such as "comprise", "include", "incorporate", "contain", "is" and 
"have" are to be construed in a non-exclusive manner when interpreting the description and 
its associated claims, namely construed to allow for other items or components which are not 
explicitly defined also to be present. Reference to the singular is also to be construed in be a 
10 reference to the plural and vice versa. 
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CLAIMS: 



1 - A method of processing a serial data signal to generate a corresponding 

transformed signal, the method including the steps of: 

(a) providing one or more signature sequences; 

(b) analysing the serial data signal to determine therein one or more signal 

5 sequences for which holds that combining such one or more signal sequences with said one 
or more signature sequences does not result in generation of illegal states; and 

(c) combining one or more of the determined signal sequences of the serial data 
signal with said one or more signature sequences so as to transform the serial data signal into 
the transformed signal. 

10 

2. A method according to Claim 1, wherein the serial data signal is a 1-bit data 
signal in binary format, and the one or more signature sequences are arranged to be directly 
combinable with the serial data signal to generate the transformed signal in binary format, 
preferably such combination involving addition and/or subtraction and/or exclusive-OR 

15 operations. 

3. A method according to Claim 1, wherein the serial data signal is arranged such 
that its series of symbols have substantially similar significance. 

20 4. A method according to Claim 1, wherein the one or more signature sequences 

are useable to reversibly transform the transformed signal to regenerate a copy of the serial 
data signal therefrom. 

5. A method according to Claim 1, wherein a plurality of signature sequences is 

25 employed in the method. 



6. A method according to Claim 5, arranged in operation to switch dynamically 

between the sequences when transforming the serial data signal into the transformed signal. 
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7. A method according to Claim 1, wherein the one or more signature sequences 
are each two or more symbols long. 

8. A method according to Claim 1, wherein the one or more signal sequences for 
5 which holds that combining such one or more signal sequences with said one or more 

signature sequences does not result in generation of illegal states are selected according to a 
perceptual model to obtain a preferred perceived characteristic in the transformed signal. 

9. A method according to Claim 1, wherein the serial data signal and the 

10 transformed signal are 1 -bit audio signals, and the combination of the one or more signature 
sequences is performed directly on the serial data signal without transforming to another 
signal format. 

10. A method according to Claim 1, arranged to embed a watermark in the serial 
15 data signal so that the transformed signal is a watermarked version of the serial data signal. 

11. An apparatus (100) for implementing the method according to Claim 1, the 
apparatus being arranged to receive the serial data signal and output the transformed data. 

20 12. Transformed data generated using the method according to Claim 1 . 

13. A data carrier including stored thereon transformed data according to Claim 

12. 



25 14. Computer software operable when executed on a computing device to 

implement the method according to Claim 1 . 

15. A method of processing a transformed signal to regenerate a corresponding 

decoded serial data signal, the method including the steps of: 
30 (a) providing one or more signature sequences; 

(k) analysing the transformed signal to determine therein- one or more signal 

sequene^fof^^ 

or more signature sequences does not result in generation of illegal states; and 
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(c) combining one or more of the determined signal sequences of the transformed 

signal with said one or more signature sequences so as to transform the transformed signal to 
regenerate therefrom the decoded serial data signal. 

5 16. An apparatus for implementing the method according to Claim 1 5, the 

apparatus being operable to receive the transformed data signal and output the decoded serial 
data signal data. 



10 



17. Computer software operable when executed on a computing device to 

implement the method according to Claim 15. 



I 
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ABSTRACT: 



There is described a method of processing a serial data signal to generate a 
corresponding transformed signal, for example encoded signal. The method includes steps of: 

(a) providing one or more signature sequences; 

(b) analysing the serial data signal to determine therein one or more signal 

5 sequences for which holds that combining such one or more signal sequences with said one 
or more signature sequences does not result in generation of illegal states; and 

(c) combining one or more of the determined signal sequences of the serial data 
signal with said one or more signature sequences so as to transform the serial data signal into 
the transformed signal. 

10 Moreover, there is also described apparatus (100) operable to execute the 

method and/or a corresponding inverse method. 
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